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1. The research described In this report was part of the work In a 
series of studies to determine how Army personnel in Mental Category 
IV and in other mental categories compare in their job performance and 
in their overall suitability for military service. 

2. Job performance in Armor Crewman (M0S HE), General Vehicle Repair- 
man (M0S 63C) , Unit and Organizational Supply Specialist (MCS 76Y), and 
Cook (M0S 94B) was evaluated by using intensive job sample tests, job 
knowledge tests, and supervisor ratings. Information concerning the 
demands for reading, arithmetic, and listenirg skills was also gath^r^d 
and compared with skill levels of the men in the MOSs. These data are 
summarized in the report with special reference to comparisons between 
lower and higher mental category personnel. 

3. This report and others in the series should be of interest to those 
persons concerned with utilization of personnel, training and training 
management, and curriculum design, especially as these relate to training 
of personnel in lower mental categories. 
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FOREWORD 



This report presents a summary cf the findings of two HumRRO Work Units that 
have yielded a substantial amount of factual information on the performance of Category 
IV men in four Army jobs. How well they were doing was compared with how well 
Non-Category IV men who had equivalent job experience were doing. In addition, each 
man was given an extensive battery of special tests, and background information on each 
was recorded from Army records Relationships between these kinds of data and job 
performance were computed to determine what factors, in addition to AFQT score and 
job experience, might predict job performance. 

Summary conclusions from these two Work Units and from related HumRRO 
research are presented in the first chapter of this report. The second and third chapters 
summarize the results of the two Work Units. Detailed reports of each will appear in a 
series of HumRRO Technical Reports. 

The purpose of this report is to present information as background for the formula- 
tion of manpower policy. While the implications of several findings are discussed in order 
to suggest options for planners, specific recommendations are not made. 

A few words about the origins of these research programs are in order. Since the 
early 1950s, we in HumRRO have done research on various aspects of the relationship 
between aptitude and learning and between aptitude and performance. In 1955, the 
effectiveness of a special Army remedial education program for marginal men was 
examined. Shortly thereafter, studies were begun on the kinds of training techniques 
most effective with lower aptitude personnel. In 1964, HumRRO participated in the 
preparation of Marginal Man in Military Service ; A Review, a publication of the Depart- 
ment of Defense, that brought together most of what was known about the topic at the 
time. In 1966, we completed a study of the performance of Category IV and Non- 
Category IV men in Army basic training. Also, at about that time, research was planned 
in support of the special training and education program (STEP) which had been 
proposed by the Army, 

In the summer of 1966, the Assistant Secretary of Defense for Manpower and 
Reserve Affairs, Mr. Thomas Morris, invited proposals from several research agencies 
concerning the military use of marginal manpower. These were to be related to “Project 
100,000,” soon to be announced by the Secretary of Defense, Among the proposals 
made by HumRRO was one that resulted in Work Unit UTILITY, given this code name 
to tuggest the major purpose of the work: to determine “the utility** of Category IV 
men in representative military occupations. Formal work was begun in January of 1967. 

As this research got under way, further consultations with OASD (M&RA) resulted 
in the formulation of Work Unit REALISTIC, the code name suggesting its intent; to 
determine the importance of REAding, Listening, and ArithmeTIC in the performance of 
military jobs for men of various aptitudes. This work began in April 1968. A substantial 
proportion of the data was gathered from the same men who were studied In UTILITY. 

The data from both of these studies are unique in at least three respects: First, the 
main criteria of job performance are derived from job sample proficiency tests in which 
soldiers performed tasks representative of each job with real equipment in field settings. 
Each test lasted from three to five hours. Performance was objectively scored. Second, 
comparisons between Category IV and Non-Category IV men are made on the basis of 
pairs of men who are matched for job experience. Third, the very large number of special 



tests and items of background information constituted an unusually rich body of 
information. 

It is worth noting that data of this sort are not easy to obtain. The development of 
the proficiency tests required a substantial amount of research into the job requirements 
and duties as well as successive trials to develop discriminating and reliable test instru- 
ments. The assistance of a team of military specialists was required in this work. The 
location of subjects in sufficient quantity who could be made available from their 
military duties required extensive coordination throughout the Army. Major testing took 
place at three CONUS sites and within the Seventh Army in Europe. Finally, the 
identification of men who not only had the required military occupational classification 
but who were actually working at the job entailed detailed review of company rosters 
and interviews with command personnel. 

In the presentation of results on UTILITY and REALISTIC, reference will be made 
to other related ongoing and planned HumRRO research. In Work Unit SPECTRUM, a 
basic research program, the relation between learning, teaching techniques, and aptitude— 
to include the entire “spectrum” of aptitudes from marginal to gifted— is being investi- 
gated to yield promising techniques for the development of appropriate training 
technology. In Work Unit APSTRAT, practical teaching strategies are being developed for 
men of differing aptitudes. Currently under way at Fort Ord, California, is an experi- 
mental course for Army signalmen that employs many new strategies, including peer 
instruction, which are proving effective with men of low as well as higher aptitudes. Ir 
the HumRRO Army Work Program for FY71, there are three units which grow out of 
the current work. In FOLLOWTHRU, men who were in the UTILITY sample will bo 
followed to determine whether they reenlisted; to assess their performance during a 
second tour and to relate these findings to data obtained on them in UTILITY. In Work 
Unit RFADNEED, techniques are being developed to determine precisely the reading 
requirements in particular military occupational specialties. Work Unit LISTEN is directed 
at the development of techniques for improving the ability of men to learn through 
listening. We found in REALISTIC that many men, particularly of lower aptitudes, 
depend more on the ear ban the eye to obtain job i elated information. 

In the report whici . follows, data will be presented on Army subjects. It should be 
made clear that no official Army position on the findings has been taken and none is 
implied in the way the findings are presented. The funding of both of these Work Units 
has been from the Office of the Assistant Secretary of Defense (Manpower and Reserve 
Affairs), which office has sponsored the work jointly with the Deputy Chief of Staff for 
Personnel of the Department of the Army. It will be apparent that the purpose of this 
report is to summarize what has been done and to indicate those relationships among 
variables which did attain significance as well as the large number which did not. These 
findings are offered as background information for the formulation of policy about the 
use of manpower. 

Chapter 1 was prepared by the authors of the report with participation by Dr. 
Howard H. McFann, Director, HumRRO Division 3. Chapter 2 was prepared by Drs. 
Robert Vineberg and Elaine N. Taylor. Chapter 3 was prepared by Drs. Thomas G. Sticht 
and John S. Caylor. 

HumRRO research for the Department of the Army is conducted under Contract 
DAHC 19-70-C-0012. Training, Motivation, and Leadership research is conducted under 
Army Project 2Q062107A712. 



Meredith V. Crawford 
President 

Human Resources Research Organization 




Military Problem 

In October 1966 the Department of Defense began accepting men with lower 
aptitudes as part of a massive social experiment designed to make effective soldiers of 
men who had generally been considered marginal in ability and to provide them with 
education and training necessary for productive and useful lives as citizens. In Project 
100,000, the aim was to take into the Armed Forces, each year, 100,000 men who 
would otherwise have been ineligible for military service. An important consideration was 
that minimum standards of military performance be maintained and that the overall 
effectiveness of the services not be diminished. 

While evidence is available that sizable numbers of men with tow-aptitude scores can 
perfonn effectively, there has never been a systematic study that identified the charac- 
teristics of marginal men who are suitable and also the kinds of jobs best suited to them. 



Approach 

Two research studies, HumRRO Work Units UTILITY and REALISTIC, were 
undertaken to obtain information on the performance and characteristics of marginal 
men. 

Tie objectives of the research in Work Unit UTILITY were to determine how men 
in Mertal Category IV end men in other mental categories compare in the perfcrmance 
of their jobs. A further objective was to identify characteristics associated with successful 
performance of jobs and to determine what background and other nonintellectual 
measures might prove useful in screening, classifying, and assigning such men. 

To accomplish these objectives, the performance of job incumbents in four major 
military occupational specialties (MOSs) was studied: Armor Crewman (MOS 11E); 
General Vehicle Repairman (MOS 63C); Unit and Organizational Supply Specialist (MOS 
76Y); Cook (MOS 94 B). Performance was evaluated by using Job Sample tests in which 
actual work tasks were performed, paper-ana-pencil Job Knowledge tests, and Supervisor 
Rating!;. In addition, numerous data were obtained on personal and background charac- 
teristic; and on a variety of cognitive tests. Groups of men from Mental Category IV 
were selected and matched with men from the higher Mental Categories with respect to 
number of months spent in the job. The performance of these high- and low-aptitude 
men was compared. 

The objectives of Work Unit REALISTIC were to provide information concerning 
the demands for reading, arithmetic, and listening skills in MOSs composed of large 
numbers of men, including the “new standards” men of Project 100,000. Also, informa- 
tion was sought on adjusting to the needs of men of low literacy levels through remedial 
training or modification of job demands. 

Relationships were examined between the reading, listening, and arithmetic skills of 
job incumbents and the performance of these men on four different indices of job 
proficiency. Ihe job incumbents were in the came MOSs studied in Work Unit UTILITY, 
and drta on three of the four different measures of job proficiency were collected in the 
UTILITY study. A fourth index of proficiency consisted of job-related reading tasks— 
tests constructed from printed materials used by job incumbents in three MOSs: General 
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Vehicle Repairman, Unit anc Organizational Supply Specialist, and Cook. The materials 
selected for the reading task tests were identified during interviews with job incumbents 
in the MOSs. Information was obtained concerning a man’s job-related reading, listening 
(i.e., acquiring information by asking others), and arithmetic behaviors. In addition, 
reading difficulty levels of the materials cited in the interviews were determined and 
compared with the reading skill levels of the men in the MOSs. 



Major Findings and Conclusions 

(1) In general, AFQT is related to job performance, although considerable overlap 
exists between Category IV and Non-Category IV men. 

(2) In a comparison of the performance of Negroes and Caucasians, no relationship 
was found between race and performance. 

(3) Supervisor Ratings (Commander’s Evaluation Report) were found to bear only a 
slight relationship to job proficiency as measured by Job Sample and Job Knowledge 
tests. 

(4) After 30 months of job experience, approximately 90% of the job incumbents 
performed at the upper levels of the performance distribution. 

(5) No relationship was found between AFQT score and the grade reached in the 
Army. 

(6) In two of the jobs studied, Repairman and Supply Specialist, the average 
difficulty level of printed job materials exceeded the average reading ability of both 
high- and low-aptitude men. The higher a man’s reading ability, the more likely he was to 
use printed job materials. The lower a man’s reading ability, the more likely he was to 
ask others (listen) for the job information rather than to read the job-related materials. 
Also, a large number of men with poorer reading ability reported that they would prefer 
to ieam by listening rather than by reading; some evidence indicates that they might 
learn prose materials as well by listening as by reading. Thus, listening as a literacy skill 
takes on special meaning for inept readers. 

(7) Reading ability, listening ability, and arithmetic skill were all found to be related 
to job proficiency as measured by Job Knowledge tests and Job Sample tests. !n addition, 
reading ability was found to be more highly related to scores on the job reading task 
tests than was AFQT. 

(8) Literacy demands were found to be highest for Supply Specialist, next highest 
for Repairman and Armor Crewman, and least for Cook. To provide a reasonable match 
between reading ability and job requirements, suggested minimal levels of reading grade 
level are: Supply Specialist— 9.0, Repairman and Armor Crewman— 8.0, and Cook— 7.0. A 
sixth grade level of arithmetic would seem to suffice for performance in these jobs. 
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Chapter 1 



SYNOPSIS OF HumRRO WORK UNITS UTILITY AND REALISTIC 
WITH MAJOR FINDINGS AND POLICY 
AND RESEARCH IMPLICATIONS 



This report summarizes the results of a series of studies that were conducted to 
determine the job proficiency of men in four major military occupational specialties and 
to identify background and personal characteristics related to effective job performance. 
The jobs selected provide representation of a broad range of job types and task 
complexity. Emphasis has been upon the evaluation of relationships of mental aptitude, 
literacy skills, and job experience to job proficiency. These studies provide information 
relevant to policy decisions concerning: Personnel accessions, classification procedures, 
training strategies most likely to optimize job proficiency, and means of matching men 
and job support materials for greater system effectiveness. 

The studies reported here were performed as HumRRO Work Units UTILITY and 
REALISTIC. Joth of these Work Units were sponsored by the Office of the Secretary of 
Defense/AssisUnt Secretary of Defense (Manpower and Reserve Affairs) and by the 
Department of the Army, Deputy Chief of Staff for Personnel. 

In this Chapter a brief synopsis of the two Work Units is given, followed by a 
presentation of the major findings with their policy and research implications, closing 
with a general discussion of the implications of these and other research studies as they 
relate to selection, assignment, reenlistment, and training of men in military jobs. The 
research and findings of the Work Units are described in more detail in Chapters 2 and 3 
of this report. 

Woik Unit UTILITY: Study of the Job Performance 
of Men in Lower Mental Categories 

The objectives of the research in Work Unit UTILITY were to determine how men 
in Mental Category IV and men in other mental categories compare both in the 
performance of their jobs and in their overall suitability for military service. A further 
objective was to identify characteristics associated with successful performance of jobs 
and to determine what background and other non-intellectual measures might prove 
useful in screening, classifying, and assigning such men. 

To accomplish these objectives, the performance of job incumbents in four military 
occupational specialties (MOSs) was studied. Armor Crewman (MOS 11E); General 
Vehicle Repairman (MOS 63C); Unit and Organizational Supply Specialist (MOS 76Y); 
Cook MOS 94B). Performance was evaluated by using Job Sample tests in which actual 
work tasks were performed, paper-and- pencil Job Knowledge tests, and Supervisor 
Ratings. In addition, numerous datu were obtained on personal and background charac- 
teristics and on a variety of cognitive tests. Samples of men from Mental Category IV 
were selected and matched with men from the higher Mental Categories with lespect to 
number of months spent in the job. The performance of these high and low aptitude men 
was compared. 
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Work Unit REALISTIC: Determination of Reading, Listening, a;,d Arithmetic 
Skills Required for Major Military Occupational Specialties 

Taking cognizance of the literacy problems to be encountered with the Project 
100,000 personnel, manpower planners initiated Work Unit REALISTIC. The objectives 
were to provide information concerning the demands for reading, arithmetic, and listening 
skills in MOSs composed of large numbers of men, including the “new standards’* men of 
Project 100,000. Also, information relevant to accommodating men of low literacy levels 
through remedial training or modification of job demands was sought. 

Relationships were examined between the reading, listening, and arithmetic skills of 
job incumbents and the performance of these men on four different indices of job 
proficiency. The job incumbents were in the same MOSs selected for study in Work Unit 
UTILITY. Of the four different measures of job proficiency, three were collected in the 
UTILITY study. A fourth index of proficiency consisted of job-related reading tasks— 
tests constructed from printed materials used by job incumbents in three MOSs: General 
Vehicle Repairman, Unit and Organization Supply Specialist, and Cook. The materials 
selected for the reading task tests were identified during interviews with job incumbents 
in these MOSs. During the interview, information concerning a man’s job-related reading, 
listening (i.e., acquiring information by asking others), and arithmetic behaviors were 
obtained. In addition, reading difficulty levels of the materials that had been cited in the 
interviews were determined and compared with the reading skill levels of the men in the 
MOSs. 

Additional work on REALISTIC involved considerable laboratory anu literature 
research to obtain information of potential use for reducing gaps which exist between an 
individual’s literacy skill level and the demands of his job for these skills. Much of the 
laboratory work focused on the study of listening as a substitute for reading, and is 
reported in a HumRRO Technical Report. 1 A source book for the design of training and 
job performance aids is being compiled, based on the literature research. Only the policy 
and research implications of this laboratory and literature research are discussed in this 
report. 



MAJOR FINDINGS AND POLICY AND RESEARCH IMPLICATIONS 

Before presenting the findings, one characteristic of these studies should be empha- 
sized. Because the focus of the studies was on actual job performance, the personnel 
tested were all working on a continuing daily basis in their jobs. Necessarily the studies 
do not include men who (a) failed in training, (b) were removed from their jobs because 
of unsatisfactory performance, (c) were removed from active duty because of misbehav- 
ior, or (d) were promoted out of their jobs. 

1. Information from the UTILITY research indicated that while in general AFQT is 
related to job performance, considerable overlap exists between Category IV and 
Non-Category IV men. Also, with time, an increasing proportion of men at all levels of 
AFQT appear in the upper ranges of the performance distribution. The data suggest the 
potential loss of a sizable number of good performers if entry requirements were modified 
to exclude from service those men with AFQT scores below 20. 

2. Beyond 30 months of job experience there is a clear and stable floor of 
performance which could be used to define minimum acceptable performance. If one 
considers only performance as a criterion of suitability for military service, and further 



1 Thomas O. Sticht. Learning by Listening in Relation to Altitude, Reading , and Rote-Controlled 
Speech^ HumPItO Technic*! Report 69*23, December 1969. 
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assumes that it is reasonable to invest a first tour in men of lower aptitude who are likely 
to perform effectively thereafter, then a procedure would be desirable for screening out 
those men who do not rise at least to this minimum level after an initial opportunity to 
acquire job proficiency. It is proposed that such screening could be accomplished through 
the administration of job knowledge tests at the time of a man’s first reenlistment. 
Further, since general military performance rather than job proficiency per se should be 
used as a criterion of a man’s suitability for reenlistment, it is suggested that the 
screening could be based jointly on a man’s Job Knowledge test score and on his record 
of conduct in the military prior to the time of reenlis^ment. 

3. Of the many personal characteristics that were examined in an attempt to 
identify predictors of job sample performance for Category IV men, the most promising 
was a man’s listening test score. Further research should be considered on the possible 
use of a listening test as a predictor of job performance for Category IV men. 

4. Performance of Negroes and Caucasians was compared. Negroes appear to per- 
form as well as Caucasians. This finding is particularly significant if, as some have 
speculated, the number of Negroes relative to Caucasians w r ould increase in an 
All-Volunteer Army. 

5. Supervisor Ratings (Commander's Evaluation Report) were found to bear only a 
slight relationship to job proficiency as measured by Job Sample and Job Knowledge 
tests. Since Supervisor Ratings have been designed to measure more global aspects of 
behavior, it should be recognized that when decisions are based on them (e.g., awarding 
Proficiency Pay), it may be general personality characteristics that are being assessed rather 
than job proficiency. 

6. Since, after 30 months of job experience most men perform at the upper levels 
of the performance distribution, instructional systems that offer promise of bringing men 
to these levels in a shorter time should be considered. The training literature contains a 
variety of techniques whose goal is to maximize learning efficiency. These range from the 
use of systems analysis procedures in developing and specifying training objectives and 
content, to the use of specific techniques within training, such as individually paced 
instruction and the application of systems of rewards (contingency management). 
HumRRO’s Work Unit APSTRAT 3 provides a model incorporating many of these instruc- 
tional innovations, (See last paragraph of this chapter for more detail.) 

7. Work Unit UTILITY was a cross-sectional study rather than a longitudinal one. A 
cross-sectional design does not provide assessment of the same men at different periods in 
their Army careers. Thus the superior performance of men with more job experience 
found in UTILITY could reflect the interaction of learning and a variety of selective 
processes. 3 Work Unit FOLLOWTHRU, to be undertaken by HumRRO during FY 71, 
will follow up UTILITY subjects who have remained in the Army. FOLLOWTHRU 
should provide the more definitive evidence regarding questions pertaining to the rolls of 
learning and selection. 

Work Unit UTILITY research showed no evidence of a relationship between AFQT 
and the grade reached in the Army. The evidence strongly suggests that promotion is 
primarily related to job longevity. In that men in all AFQT levels reached supervisory 
positions with equal frequency, a question of considerable importance is how men at 
these different levels of aptitude compare in their supervisory roles. Such an evaluation 



3 HumRRO Work Unit APSTRAT—Traimng Strategies and Incentives Appropriate to Different 
Aptitude Levels for Selected Army Training Courses. 

3 With the UTILITY dfU, however, it Is possible to obtain some information regarding this 
question. A few personal characteristic* were found related to superior performance. However, the 
correlations of these variables with time in the Job were examined and found negligible. This suggests 
that learning ratheT than Section is producing the greater proficiency of men with more job experience. 
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could be of particular value in the event of an All-Volunteer Army. With such a force 
structure, many have speculated that there would be greater numbers of low aptitude 
men occupying senior enlisted positions. 

9. Concerning literacy demands of jobs, information from Work Unit REALISTIC 
indicated that, where manuals were used in conjunction with the job sample performance 
tests, performance tended to improve. Concerning the use of manuals, additional informa- 
tion from REALISTIC indicated that, with the exception of the Cook’s MOS, the reading 
difficulty level of printed job materials far exceeded the reading ability of both high and 
low aptitude men. Also, the difficulty level of the materials was related to the frequency 
with which they were used on the job. If the materials were too difficult, men tended 
not to use them. However, the greater a man’s reading ability, the more likely he was to 
use printed job materials, even the more difficult materials, Thus it appears that the 
increased use of job reading materials, and hence better job performance, might be 
stimulated either by upgrading the reading skills of personnel through literacy training, 
and/or by reducing the difficulty levels of materials by the provision of systems engi- 
neered job aids. 

10. Reading ability was found to be meaningfully related to job proficiency when 
measured by performance on job reading task tests, job knowledge paper-and-pencil tests, 
and job sample tests. Reading test score was more highly related to proficiency on job 
reading tasks than was AFQT. For the Job Knowledge and Job Sample proficiency tests, 
AFQT and reading test scores predicted proficiency about equally as well. Because the 
reading test predicts proficiency on job reading tasks better than the AFQT does, and 
because the reading test identifies skill levels in a way to suggest what might be done to 
remedy a man’s skill level, rather than to simply screen him in or out of a job, as the 
AFQT does, consideration could be given to replacing, or supplementing, the screening 
instrument (AFQT) with more diagnostic, skills-oriented instruments. Such instruments 
could serve both as screening tools and as tools to indicate how much remedial training a 
man might require in some literacy skill area (reading, arithmetic, listening, writing, 
speaking) to improve his job proficiency and opportunities. 

11. Listening ability was related to job proficiency when measured by either job 
knowledge or job sample performance tests. Additional findings 4 showed that 
(a) Category IV personnel indicated that they obtained almost three-fourths of their 
information by listening; (b) one-fourth of a sample of some 300 men reported that they 
preferred to learn by listening rather than by reading (this figure rose to 49% for very 
poor readers); (c) a sample of high (Non-Category IV) and low (Category IV) aptitude 
men learned prose material as well by listening to tapes as by reading; and (d) men 
interviewed on-the-job reported many instances of listening for information, and the 
frequency of listening relative to reading was higher for poorer readers in MOSs where 
reading materials were most difficult. Because of the importance of listening, research is 
needed to study the listening process further and to attempt to improve listening/thinking 
skills. Such a project, Work Unit LISTEN, 3 is underway at HumRRO Division No. 3 as a 
follow-up to Work Unit REALISTIC. 

12. Arithmetic skill was high*y related to reeding and AFQT and to job proficiency 
when measured by either Job Knowledge or Job Sample tests, While arithmetic skills 
showed some promise as a predictor of job performance, interviews with job incumbents 
in the Repairman, Supply Specialist, and Cook fields indicated very little actual use of 



- Thomas G. SticM. Learning by Listening in Relation to Aptitude, Reading, and Rate Controlled 
Speech, HumRRO Technical Report 69-23, December 1969. 

5 HumRRO Work Unit LISTEN— Development of Automated Programs to Improve Listening Skills 
Required in Army Jobe. 
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arithmetic on the job. Overall, demands for arithmetic skills did not exceed what is 
ordinarily taught in the first six grades in school. 

13. Literacy demands were found to be highest for Supply, next highest for 
Repairman and A^mor Crewman, and least for Cook. If remedial training is given with 
the aim of providing a closer match between a man’s ability and job requirements, 
suggested targeted grade levels of reading skills are: Cooks— 7.0, Armor Crewman and 
Repairman— 8.0, and Supply— 9.0. Since the requirements differ from job to job, remedial 
training would appear most effective when geared toward a specific job. General, non-job- 
related literacy training geared as it is presently in the Armed Services to a uniform 6.0 
grade level, would appear to offer minimal efficiency as far as job proficiency is 
concerned. Use could be made of diagnostic literacy tests applicable to a job area selected 
by the man prior to his enlistment, to identify both minimal enlistment skills, and to 
place the man at some position relative to the targeted reading level for the job area. 
Upon accession, men deficient in job-related literacy skills could be provided with 
remedial training, using job-relevant reading, listening, and arithmetic materials, to 
improve their job proficiency and general military suitability. 

14. Literature research in REALISTIC has indicated that, where design of job 
materials is concerned, considerable evidence indicates that properly designed job manuals 
can enable the less experienced and less literate men to achieve acceptable job perform- 
ance, with fewer errors and little or no loss in time, and with much less training than 
usually given. The approach to manual design should be a “systems” or “task analytic” 
approach, with the aid pre-tested on the prospective user. If materials were redesigned to 
facilitate job performance of men in the MOSs studied in REALISTIC, then men having 
literacy skills below those identified (12, above), could be expected to use the materials 
and to perform more effectively while receiving remedial literacy training to permit them 
to move into higher level jobs where the use of general military publications would be 
necessary. 

15. Because of the moderately high correlations of reading skill with Job Knowl- 
edge, care must be exercised to insure that, in fairness to incumbents, if their elimination 
or retention or promotion is made contingent to a large degree upon job knowledge test 
performance, then formalized procedures should be implemented to insure that men have 
the opportunities to acquire the job knowledge and the literacy skills required to take the 
test, whether these be reading, listening (if the test is orally presented) or arithmetic, or 
other language /communication skills. If men of lower literacy skills are accepted into 
service, then their later job security should not be contingent upon the acquisition of 
higher skill levels unless formal programs are available and emphasized during the early 
career period. This would seem to be of even greater importance if the manpower 
requirements are to be filled on the basis of a zero dependency on the draft. 



DISCUSSION 

This discussion incorporates the findings of Work Units UTILITY and REALISTIC 
with information available from HumRRO Work Units SPECTRUM and APSTRAT in 
order to present a more integrated statement of implications for personnel policy. 



SELECTION AND ASSIGNMENT 

If ihe manpower pool were composed of a large number of high aptitude personnel 
who were attracted to the military, then the use of general aptitude tests as selection 
devices would be quite effective, by admitting only those persons who score high on 
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aptitude tests, it would be anticipated that fewer disciplinary problems would arise; fewer 
training problems would be encountered and training costs would be reduced; in addition, 
initial levels of job performance would be higher. Even so, a fair number of high aptitude 
persons would be admitted who do not perform effectively. 

However, with the broad range of AFQT which is characteristic of the population 
available, there is considerable overlap among AFQT groups in performance during 
training and subsequently in the job. Consequently, those men who would be excluded 
from the military on the basis of their low AFQT scores include a considerable number 
of men who perform well. 

Given the relatively moderate relationship between AFQT and performance and the 
limited amount of diagnostic information provided by such a general aptitude test, it is 
desirable to consider other types of instruments which, in addition to screening at least as 
well sis the AFQT, are better suited for providing information about specific strengths 
and weaknesses that focus more directly on the kinds of remediation that may be 
necessary. If diagnostic instruments were adopted for use in conjunction with, or in lieu 
of, the AFQT, they could be used to determine a person's entry level skills, knowledge, 
and interests. Such information could be utilized during the classification process and in 
determining the training required as well as the remediation needed. Examples of ways 
of presenting such material so that it would be useful to policy makers are presented in 
some detail in Chapters 2 and 3 (see Figures 2-6 and 3-5 for examples). Such information 
would be \:seful for establishing reenlistment policies as well as for initial entrance into 
the service. 

If adopted, diagnostic instruments should be selected on the basis of their relevancy 
to families or clusters of jobs. 6 



REENLISTMENT 

The findings from these studies indicate both the desirability and the feasibility of 
developing and employing Job Knowledge tests to establish reenlistment elegibility. 
Screening tests designed for this purpose should assess only those knowledges directly 
required in the performance of the job. Test items should be designed to match the 
literacy level of job incumbents. As discussed in (2) above under Major Findings, it is 
anticipated that such a knowledge test would be employed in conjunction with the man’s 
record of conduct. 



TRAINING 

Data from HumRRO’s Work Unit SPECTRUM showed that no more than 3% of the 
students in Combat Support Training Courses with AFQT scores of 31 or higher were 
recycled for academic deficiencies. In contrast, as many as 12% of the students with 
AFQT scores between 16 and 30, and 25% of those with AFQT scores between 10 and 
16, were academic recycles. It was evident that every effort should be made to identify 
training procedures which are maximally effective with lower aptitude men. 



excellent example of a system of clustering baa been provided by DCSPER, D/A in the Army 
Functional Specialties System (ARFS). If the AFRS concept w?re coordinated with the system employed 
by the IPS. Employment Agency (using the Dictionary of Occupational Titles) a man’s military experience 
could then be directly related to civilian occupations both at the beginning and it the termination of service. 




19v 



8 



1 



In Work Unit SPECTRUM it was found that method of instruction was critical for 
low aptitude individuals. Using the conventional lecture-demonstration paradigm, marked 
individual differences in reaching a standard of proficiency were observed witu learning 
taking up to five to six times as long for the low' aptitude individual as for men with 
AFQTs between 90 and 100. However, it was found that instructional methods that 
emphasized considerable structure in the learning situation and the presence of a living 
instructor to provide almost constant prompting and feedback were essential ingredients 
in the efficient training of low aptitude men. 

The data from Work Unit UTILITY further affirm the importance of direct experi- 
ence. The effects of job experience upon Job performance were clearly demonstrated. 

Further evidence of the desirability of such an approach to training can be found in 
HumRRO’s Work Unit APSTRAT* In APSTRAT a training system featuring peer instruc* 
tion in a functionally relevant job-simulated context was developed. The model empha- 
sizes task performance, individualized instruction, mastery to a fixed criterion, and 
rigorous quality control. The program takes a man through a sequence of first observing 
performance of a task, then learning the task, next displaying mastery of the task in a 
performance test situation, and finally serving as an instructor for a student in the earlier 
observation and learning phase of the sequence. Mastery of each individual learning task, 
regardless of AFQT, is required and has been shown attainable with this system of 
instruction. The APSTRAT concept ; s currently being recommended for wider implemen- 
tation throughout the Army by the Volunteer Army Task Group. 

Such findings are compelling: the maximization of hands-on experience, the per- 
formance of job-simulated tasks during training, and the utilization of on-the-job training 
wherever possible should lead to heightened performance in a shorter time. 
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Chapter 2 



PERFORMANCE IN SELECTED ARMY JOBS BY MEN 
AT DIFFERENT APTITUDE (AFOT) LEVELS-WORK UNIT UTILITY 



Work Unit UTILITY, initiated in January 1967, was designed to provide information 
about the performance and characteristics of marginal men in the Army. It had two 
major objectives. The first was to find out how men in Mental Category IV and in other 
mental categories compared in the performance of selected Army jobs. These comparisons 
were to include analyses of tasks where greater and lesser degrees of competence might 
be displayed. 

The second objective was to identify different factors associated with satisfactory 
performance in different mental category groupings. The intent was to explore both the 
role of a man’s background and personal characteristics and his more general Army 
experience (such as the length of time he has spent in the job) as they relate to 
performance. 

The following criteria were used to identify jobs where performance would be 
studied: 

(1) The jobs, taken together, should cover as broad a range as possible of job 
types and task complexity. 

(2) Insofar as possible, jobs should have counterparts in civilian occupations to 
maximize the likelihood of research findings having applicability beyond the military 
setting. 

(3) Each job should have relatively large numbers of men assigned to it within 
the Army so as to provide an adequate sample of men for the study. This would also 
increase the practical use of any research findings that might prove to be specific to the 
job studied. 

(4) Jobs should be selected in which reasonably large numbers of lower 
aptitude men are assigned. 

(5) Insofar as possible, jobs should be chosen that have counterparts in each 
military service. 

Five Army jobs were selected: Armor Crewman, MOS 11E; General Vehicle Repair- 
man, MOS 63C; Unit and Organizational Supply Specialist, MOS 76 Y; Cook, MOS 94B; 
and Medical Specialist, MOS 91B. 

Armor Crewman is a machine-ascendant job consisting principally of sequences of 
interaction between a man and a weapon system. Tasks are largely procedural. It is the 
only MOS selected that did not have counterparts in the other military services or in 
civilian occupations. Repairman is a mechanical maintenance job requiring diagnostic and 
interpretive skills. Supply is a clerical job calling for the coordination and recording of 
information. Cook is a job having as its primary requirement the recognition of standards 
and precision in meeting them. Medical Specialist is a man-ascendant job in which 
proceduralized tasks are directed towards the processing and treatment of individuals. 

In each job, proficiency was measured by using intensive Job Sample performance 
tests, conventional multiple-choice Job Knowledge Tests, and Supervisor ratings. The Job 
Sample Tests, of 3-5 hours duration, are considered the primary measure of job capa- 
bility. They were comprised of a series of subtests, each requiring the performance of an 
entire task with a natural beginning and ending as it would ordinarily occur in the job. 
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Tasks included in the Job Sample Tests covered a range of difficulty and frequency of 
occurrence in the job. 

Data on personal characteristics, including background and demographic information, 
were collected from military records and through the administration of biographical 
questionnaires and a variety of published and experimer/ul paper*and-pencil instruments. 

To insure that job incumbents had been exposed to the fullest range of job demands 
in their MOS, Armor Crewmen, Repairmen, and Supply Specialists were tested in TO&E 
units in CONUS and USAREUR. Cooks were tested in TO&E units in CONUS and at 
Fort Ord, California. Medical Specialists were tested at Army Hospitals in CONUS. 

At each location where data collection occurred, pairs of men v/ere selected for 
testing. Each pair included one man in Mental Category IV (lower aptitude, AFQT of 
10-30) and one in Mental Categories I - III (higher aptitude, AFQT greater than 30, also 
referred to as Non-Category IV in this report). In an effort to insure equal amounts of 
job exposure for the Category IV and Non-Category IV samples, pair members were 
matched for the amount of time they had been in their jobs. Only men who were 
working on a continuing daily basis in the selected MOS were studied. The sample 
included men in each MOS with up to 20 years of job experience. The total number of 
men tested is shown in Table 2.1. In order to provide representation of subjects with 
more than two years of job experience, the selection of Category IV subjects was not 
limited to Project 100,000 acceptees. Approximately 1550 of the men in Mental Group 
IV came from Project 100,000.' 



Table 2.1 



Number of Men Tested in Work Unit UTILITY 



Location 


I Armor 

Crewman 


Repairman | 


.Supply 

Specialist 


Cook 


Med ical 
Specialist 


1st Armored Division 


28 


64 


.56 


66 




2nd Armored Division 


62 62 


108 


90 


100 


— 


5th Infantry Division (M) 


52 


224 


114 


- 


— 


4lh Armored Division 


242 


— 


150 




— 


Fort Ord 


— 


— 


— 


214 




Army Hospitals 


- 


- 


- 


- 


266 


Total 


384 


396 


410 


380 


266 



The remainder of this section contains a summary of the major study fir lings. It 
includes the results of all criterion testing in Armor Crewman, Repairman, Supply 
Specialist, and Cook* ; a description of those personal characteristics found to be related 
to performance criteria; analyses of the job duties of men at different AFQT levels; a 
comparison of the performance of Negroes and Caucasians; and a comparison of the 



1 A small number of Category V personnel (AFQT less than ID) in the sample are included with 
Category IV personnel In analy-e* and discussion. 

* Information about the Medical Specialist is not included in this summary report. Job 
specialization In this MOS was found to be considerable. Sampling procedures and analysis of these data 
differed from those followed for the other four jobs, and for this reason information on this MOS will 
be reported separately. 
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performance of draftees and enlistees during the first two years of service. 3,4 Detailed 
information about the research and a complete presentation of the findings is being 
published by HumRRO in a series of technical reports: 

Performance in Five Army Jobs by Men at Different Aptitude (AFQT) Levels: 

1. Purpose and Design of Study. 

2. Development and Description of Instruments. 

3. Comparison of Men With Different Amounts of Job Experience. 

4. Relationships Between Literacy Variables and Performance Criteria. 

5. Relationships Among Performance Criteria. 

6. Performance of the Medical Specialist. 

Performance on Job Sample Tests 

Job Sample data are examined as they vary with AFQT level ■ and months of job 
experience (MOJ). To provide a picture of the changing pattern of scores across the 
broad range of job experience and to show the considerable overlap of the Category IV 
and Non-Category IV distributions, a scatter plot of individual scores on the Repairman 
Job Sample Test is presented in Figure 2.1. The general pattern of scores shown in this 
Figure is characteristic of the other jobs. 

In each MOS there is great variability among men in both the IV and Non-lV mental 
categories during the first 30 months of job experience. In particular there are both 
Category I Vs and Non-Category IVs who achieve scores in the upper part of the 
distribution. The major change during this period is a decrease in the occurrence of low 
scores. After 30 months the majority of scores fall within a restricted range a* the upper 
end of the distribution, with a rather clear and stable floor of performance being evident. 
While these changes presumably reflect the effects of increasing job experience, it must 
be noted that this pattern may represent some composite of the effects of job experience 
and of selective reenlistment and reassignment processes. In a cross-sectional study, such 
as this one, it was not possible to isolate the effects of selection. 5 

HumRRO Work Unit FOLLOWTHRU, to be initiated during FY 1971 will identify 
men in the UTILITY sample who have reenlisted after their first tour in the Army. 
Criterion scores and other characteristics of this group will be compared with the group 
which has separated. FOLLOWTHRU should provide more conclusive evidence regarding 
questions of learning or selection. 

Mean Job Sample Scores for three AFQT levels (Low IV, High IV and NondV) and 
six months-on-job (MOJ) levels are plotted in Figures 2.2— 2.5. 

3 Analysis of the effects on job performance of different types of training was not possible. It was 
not feasible to control sampling for this viable. Also, as men remained in their jobs longer, a wide 
variety of different training experiences intervened. The effects of a specific type of training could not, 
therefore, be studied. 

4 A gross measure of general suitability, based upon a count of misconduct entries found in each 
man’a permanent record, was included in the study. No differences with respect to AFQT w.*e found 
using this measure. This lack of relationship, however, is quite inconclusive. The index of misconduct 
suffered from a variety of limitations. For example, of necessity the study included only those men who 
were available for duly. Any man who was AWOL, confined to the stockade, or otherwise unavailable as 
a subject, could not be included. Thl* restriction considerably reduced the incidence of misconduct 
found. No further discussion of misconduct Is contained in this report, 

3 Within the UTILITY data, however, some information bearing on this question was available. Only 
a few personal characteristics (e.g., AFQT) were found related to superior performance and the 
correlations of these /ariable* w’.th time lr, the job were examined and found negligible. Within the 
UTILITY data, learning rather than selection was evidenced by improvement of proficiency within the 
first 18 months. This tends to suggest that learning U responsible for the greater proficiency of men 
© irith more job experience. 
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Job Sample Data: Repairman 
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Armor Crewman's Job Sample Score by Time on Job for AFQT Groups 
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Supply Specialist's Job Sample Score by Time on Job for AFQT Groups 
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Cook's Job Sample Score by Time on Job for AFQT Groups 
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While the curves show some variation in rate of growth with different amounts of 
displacement between comparable groups from one MOS to another, the overall pattern is 
clear. Performance improves both as a function of increasing AFQT and increasing MOJ. 6 
In general, through five years on the job, Non-IVs exceed High lVs, who, in turn, exceed 
Low IVs. Beyond five years there is some evidence of convergence, with points being 
closer together and positioning relative to AFQT being lost in at least two of the jobs. 
While the graphs using means show clear separation between AFQT groupings out to 
at least five years, it has been obvious in the scatter plots that a great deal of overlap 
exists. An alternate method of presenting data is to group subjects aaccording to their 
position in the Job Sample distribution. In Figure 2.6 the percentages of men in the 
different AFQT groupings falling in the lowest, two middle, and highest quarters of the 
Job Sample distribution are presented. The figure is drawn for men with 1-18 months of 
job experience for all MOSs combined. 

Figure 2.6 reflects the general relationship between AFQT and job performance. 
Thus it is seen that there is a greater probability that men at the lower end of the AFQT 



Distribution of AFQT Groups With 1-18 Mmths-on-Job 
on Job Sample Tests (Four MOSs Combined) 




AFQT Groups 
Figure 2.6 



*In graphing the Job Sample data {a* well as Job Knowledge and Supervisor ratings, reported 
subsequently), the groups have been organized to display a a many points at various AFQT or time 
Intervals as the number of aubjecta and the regularity of the data permit. Statistical teats of differences 
between group*, were confined to more restricted grouping* with considerably larger numbers of 
subjects. Both the difference* between AFQT level* (Low IV, High IV, Non-IV) and the differences 
between MOJ leveta (T9, 10-24, 25+) were found to be reliable. 
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distribution will perform in the lowest quarter. This is mirrored at the high end of the 
distribution where men are more likely to score in the highest quarter. However, the 
critical observation is that a substantial proportion of men at all AFQT levels falls into 
each quarter of the Job Sample distribution. For example, 33% of the 0—20 AFQT group 
score in the upper half of the distribution whereas 25% of the 65—99 AFQT group score 
in the lower half of the distribution. In the first 18 months the similarity of performance 
of the High Category IVs and Category Ills is striking. A little less than half (44%) of the 
High Cat IV group scored above the median, whereas a little more than half (56%) of the 
Cat Ills scored above the median (the latter group having been historically acceptable for 
service). 

Men with between one and 18 months of job experience made up 67% of the 
UTILITY sample in the four MOSs reported. The Army in general is heavily weighted 
with men from this time segment— approximataly the first two years of a first tour. 
Since, at ary given time, most men working in an MOS fall within this first year and a 
half of job experience, performance in this time segment approximates modal perform* 
ance in the Army. The data for men with longer job experience have been sorted into the 
quarters used for the 1—18 month group to compare their performance. Figures 2.7 and 
2.8 display these data. 

The implications to be drawn from these Figures are clear. With time, an increasing 
proportion of men at all AFQT levels appear in the upper ranges of the performance 



Distribution of AFQT Groups With 19-30 Months-on-Job on Job Samole Tests 
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100 r- 

90 - 
r 

■ 80 - 



Low Quarter 
Low Middle Qutfer 
High Middle Qualw 
I Quarter 




Low Catetonr IV 
0-20 



HWt Citnonf iv 

21-30 



Category III 
3H4 



AFQT Grcwps 

Mgure 2.7 



Categories Ml 
$ 5^9 




17 




Distribution of AFQT Groups With 31+ Monthson-Job on Job Sample Tests 

(Four MOSs Combined-in Relation to Quarters of 1-18 MOJ Subsample) 




distribution. Thus, among men with 19-30 months-of-job experience, 59% of the Low 
Category IV group fall in the upper half of the distribution. In the 30+ months gioup, 
35% of the Low Category IV group fall *n this upper half. These data suggest the 
potential loss of a sizable number of good performers in the first 18 months on the job, 
as well as even larger numbers of good performers beyond 18 months, if men with AFQT 
scores below 20 are excluded from the service. 



Performance on Job Sample Tasks of Varying Difficulty 



The performance of Category IVs and Non-Calegory IVs on tasks ol varying 
difficulty was comprred. Job Sample subtests were grouped into three levels of difficulty. 
For illustrative purposes Arrjor Crewman performance on “easy,” “medium,” and “dif- 
ficult” subtests is presented in Figure 2.9. In each of the MOSs, the data generally 
indicate: 

(1) Separation of pairs of curves representing varying levels of difficulty is 
maintained over time. 

(2) Non-Category IVs are superior to Category IVs within the same difficulty 

level. 

(3) Separation between Category IV and Non-Category IV curves increases as 
tasks increase in difficulty. 
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Performance on Easy, Medium, and Difficult Tasks: 
Armor Crewman by AFQT and MOJ (percent) 




Months on Job Months on Job Moults on Job 

Easy Medium Difficult 

Figure 2,9 



(4) Growth m performance occurs as a result of experience at each level of 
difficulty. The least change is sjen in "‘easy 11 tasks where performance is at a fairly high 
level almost immediately upon entry into the job.' 

Although the size of differences between AFQT or job experience groupings 
obviously depends on the particular intervals selected for comparison, larger differences 
appear across the job experience dimension than across the AFQT dimension. 

Performance on Job Knowledge Tests 

Scatter plots of individual Job Knowledge scores were found to be generally similar 
to scatter plots of Job Sample scores. Like the Job Sample tests, performance on Job 
Knowledge tests was quite variable during the first 30 months of job experience. With 
additional experience there was a progressive diminution of the lower scores with a 
resultant decrease in variability and a higher mean performance. The overlap between the 
Category IV and Non-Category IV distributions was again considerable. Mean Job Knowl- 
edge scores for three AFQT levels and six MOJ levels are given in Figures 2,10—2.13. 

The relationship of Job Knowledge scores to AFQT and MOJ is much the same as 
that observed with the Job Sample data. Performance improves both as a function of 

7 Difference* attributable to AFQT and MOJ on Uaka of varying difficulty were reliable in all 
instance* except for comparison* of AFQT group* among Cooks on the “easy” task. 
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Armor Crewman's Job Knowledge Score by Time on Job for AFQT Groups 




Figure 2.10 



Repairman's Job Knowledge Score by Time on Job for AFQT Groups 
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Supply Specialist's Job Knowledge Score by Time on Job for AFQT Groups 
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